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Abstract 

An overview of the design and use of a Smart Prosthetic Hand is provided in this study. This study 
presents an overview of computational methods for brain, gesture, and voice signals to operate a 
robotic arm. There are several hundred million neurons in the human brain. A prosthetic arm powered 
by a Brain-Computer Interface (BCI) based on electroencephalograms (EEG) is a non-invasive 
approach that can be a powerful aid for persons with severe disabilities in their daily lives, particularly 
to let them use their arm voluntarily. The brain’s EEG data is recorded by the Brainsense headset and 
processed by a microprocessor to move the prosthetic hand via controlling servo motors. Additionally, 
a glove controller that replicates the gestures is used. The method entails using flex sensors to control 
the arm's movements. The voice control system was created so that voice commands could be sent 
through Bluetooth to control prosthetic arms. With the aid of a microcontroller, all actions can be 
monitored by a user interface. This prosthetic arm can help patients who have amputees below the 
elbow. This essay's main objective is to enable people with physical disabilities to become less 
dependent on others for their everyday needs. This model would be very helpful in both the real world, 
especially for those with disabilities who are unable to use their hands, and in the classroom when 
employed by college students pursuing robotics as a subject. The work given here is a mini-project 
that is taken up as a part of the curriculum completed by electronics and communication engineering 
students in the second year of the electronics & communication engineering department at Dayananda 
Sagar College of Engineering in Bangalore. 
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1. Introduction 

The inspiration for this idea came from persons with disabilities, stroke patients who have motor 
deficits, war veterans who lost their arms, and individuals who are unable to control their hands and 
arms. According to recent surveys by the World Health Organization (WHO), half of all people 
worldwide live with some sort of disability, which affects around 15% of the population [1]. There 
are around 5 million crippled persons in India. In the world, there are approximately 10 million 
amputees, 30% of whom have lost one arm [2]. The three main causes of limb loss are illnesses, birth 
abnormalities, and traumatic events. Other common causes are injuries sustained in motor vehicle 
and cruiser accidents [3]. One of the most coveted robotic and prosthetic accomplishments, as well 
as one of the most challenging engineering goals ever, is to replicate the human hand [4]. Hand 
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gestures are a common form of human contact and are effective in HCI [5]. The prevalence of 
amputees and patients with limb impairment is rising overall for a variety of political, economic, 
scientific, and demographic reasons. Although artificial limbs have been around for a while, their use 
and interaction with the environment are not very natural. They call for invasive surgical intervention 
[6]. 

The fundamental objective of such intricate treatments is to redistribute nerves so that amputees may 
operate their prosthetic devices simply by thinking about what they wish to do [7]. Robots are 
employed not just in industries but also in everyday life. A robotic arm is a sort of mechanical arm 
that performs tasks akin to those of a human arm and is typically programmable. To complete jobs, 
robotic arms are used in a variety of sizes and configurations [8]. This project's main objective is to 
support physically disabled people in their daily lives. Here, the robot picks up and places any thing 
to assist the impaired person in becoming independent. For users to benefit in freedom, self- 
realization, and social inclusion, assistive robot efficiency must therefore be improved at several 
levels [9]. The invention of electroencephalography (EEG) and Hans Berger's discovery of the 
electrical activity of the human brain are at the foundation of the history of brain-computer interfaces 
(BCI) [10]. Berger was the first to use an EEG to capture human brain activity in 1924. Using his or 
her brain activity, a person can communicate with an automated system like a robot or prosthesis 
through a BCI, which is a non-muscular communication channel. There are many uses for BCI 
systems, including controlling a wheelchair prosthesis or a cursor on a screen, as well as multimedia 
and virtual reality [11]. 

Acquisition is a representation of one of a BCI system's most crucial elements. The most used 
acquisition method is EEG, which offers an affordable and transportable acquisition solution [29]. 
The EEG method relies on scalp electrodes being placed to the subject to record brainwaves. EEG 
signals have low-level amplitudes of the order of microvolts and oscillate between 1 Hz and 100 Hz 
in frequency. Specific properties are extracted and linked to various patient brain activity states as 
well as directives for apps that have been built [12]. 
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Acquisition 


Female 


Embedded System Embedded System 


and IMU 
Fig.1: Applications of BCI interface prototype that is going to be developed in our project 
Fig. 1 gives the prototype of the prosthetic hand that is going to be developed in our project. Although 
speech recognition algorithms have been developed for a while, they recently gained prominence as 
a result of significant advancements in voice recognition performance and resilience, which enable 
cutting-edge machine learning methods [28]. Many elderly assistance robots can be operated with 
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joysticks, tablets, PCs, etc. [13], but some people may find it difficult to use them; in this case, a 
voice-controlled robot can be used to solve the problem. To process the user's voice through distant 
servers, the majority of modern speech control systems, including those found in smartphones and 
home automation, need an internet connection. Due to autonomy and safety considerations, it is ideal 
for an assistive technology to work without an internet connection [14]. 

This has a significant impact on the use cases that may be developed with voice recognition devices. 
In this project, we use a robotic arm to carry out the intended action while transmitting voice 
commands through Bluetooth to a preprogrammed controller [15]. Glove-based techniques that assess 
hand and arm joint angles and spatial position are among the most widely used methods[16]. The use 
of this gesture recognition technology has become more widespread in a short period of time. The 
flex sensors are an effective tool for identifying and detecting human body motions due to their 
moderately low cost and relatively small size [17]. The primary goal of gesture recognition in this 
work is to identify a specific hand motion and deliver an appropriate instruction to a robotic system 
for action execution [18]. 


2. Objectives & Scopes 

The goal of our initiative is to assist people with disabilities in living a normal life and carrying out 
their everyday tasks more effectively and efficiently without the assistance of others [27]. It mostly 
aids those who have lost their hands as a result of conflict, those who are paralysed, and those who 
have lost control of their limbs. Without requiring any brain surgery, BCIs convey the subject's 
thoughts, which have been converted into control signals by brain electrical activity, for external use 
[30]. This aids the individual who need support. With the help of this technology, a completely 
dependent person can become somewhat autonomous, which will benefit both their physical and 
mental health [26]. The project's specific objective was to make controlling assistive robots more 
natural and to have them carry out various duties more quickly and efficiently via voice instructions 
[25]. To accurately duplicate only a few of the motions available with the human hand, it is best to 
design for a very simple prosthetic hand [24]. Designing a highly complicated prosthesis that could 
imitate every hand gesture possible would be challenging and unnecessary. However, the prosthesis 
must be made to allow the hand's selected articulations to appear as natural as feasible [21]. 

The prosthesis would need to be made with strength, stability of motion, and long-lasting elements, 
taking into account the necessity for a sturdy design since it may be used in daily life. Aside from 
needing to be too sophisticated in terms of machine operations, the parts would also need to be 
designed to allow for simple machining. The major goal is to create a trustworthy, affordable 
prosthetic arm control circuit. Additionally, it is necessary to create a smart prosthetic arm that can 
do complicated navigational tasks (select and put objects in a realistic environment) for persons with 
disabilities. This arm would employ signals from the brain that were recorded and processed [20]. 
The design of the prosthetic hand mimics the gestures and responds appropriately. voice instructions 
can be used to control the hand [22]. Additionally, based on the signals analysed, to automate the 
home and send a warning message to family members in the event of an emergency, as well as the 
GPS location of the person using the prosthetic hand [23]. 


3. Conclusions and Next Steps 

The work presented in this paper gives a small indepth information about the prosthetic hand which 
we are going to develop in our project work. Prosthetics is one of the many applications for Human 
Robot Interaction (HRI). In order to obtain EEG data from the brain utilising the brain's electrodes 
and take appropriate action, this project develops and implements a comprehensive technique. The 
speech recognition module will effectively capture the data by responding to vocal commands. 
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